Dynamically modifying visual rendering of a visual element comprising a visual contouring associated therewith

ABSTRACT

Method and system for dynamically modifying, in an interactive computer simulation station, visual rendering of a visual element in a computer generated environment from an interactive computer simulation. Pre-defined visual characteristics comprise a visual contouring associated with the visual element. The method comprises receiving, via a tangible instrument module, one or more commands for controlling a simulated vehicle. The method also comprises dynamically affecting the visual contouring of the visual element considering at least one of a distance factor between the simulated vehicle and the visual element in the computer generated environment and a relative contrast between the pre-defined visual characteristics of the visual element and underlying computer generated environment elements. The distance factor and the relative contrast are determined in real-time during execution of the interactive computer simulation prior to rendering the visual element for display.

TECHNICAL FIELD

The present invention relates to improved interactive training and, moreparticularly, to improved immersive interactive training using asimulation station.

BACKGROUND

An interactive computer simulation system performs one or moreinteractive computer simulations. Each interactive computer simulationcomprises one or more virtual simulated elements each representing anactual system (e.g., multiple virtual aircraft systems each representingan actual aircraft). Each interactive computer simulation provides avirtual computer generated environment and various tangible instruments(or controls) in a simulation station to allow enactment of differentscenarios for the purpose of training one or more users (or trainees),using one or more of the virtual simulated elements, in the operationand/or understanding of the corresponding one or more actual systems.The virtual simulated element, or simulated element, is defined hereinas a simulated system. The simulated element is a virtual version thatsimulates, to the extent required by the interactive computersimulation, behavior of an actual system. The various tangibleinstruments accessible to the one or more users in the simulationstation replicate actual instruments or otherwise reproduce behavior ofthe actual instruments found in the actual system.

In certain circumstances, the interactive computer simulation is used todevelop and/or measure skills of the trainees in relation to specificbenchmarks. By way of example, aDetection-Orientation-Range-Identification (DORI) benchmark has beendeveloped in relation to a trainee's ability to detect and qualify atarget within a virtual scene in a flight simulator. The DORI benchmarkis particularly useful in air-to-air combat pilot training. It is oneexample of benchmarks that are based on visual acuity of the trainee.The benchmark is one of different elements of the training that takesplace in the interactive computer simulation from within the simulationstation. The benchmark is meant to provide a correlation between atrainee's ability as measured and developed in the interactive computersimulation and the actual trainee's ability in the actual systems.

Unfortunately, physical limitations of the simulation station (e.g.,image resolution, brightness and/or contrast) lead to benchmark resultsthat are difficult to reliably correlate to actual abilities. Thepresent invention at least partially addresses this concern.

SUMMARY

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter.

In accordance with a first aspect in a first set of embodiments of thepresent invention, a method is provided for dynamically modifying, in aninteractive computer simulation station, visual rendering of a visualelement in a computer generated environment from an interactive computersimulation. The pre-defined visual characteristics comprise a visualcontouring are associated with the visual element. The method comprisesreceiving, via a tangible instrument module, one or more commands from atrainee of the interactive computer simulation station for controlling,in the computer generated environment, a simulated vehicle of theinteractive computer simulation. the method also comprises, upon loadingthe visual element for display at the interactive computer simulationstation, dynamically affecting the visual contouring of the visualelement. Dynamically affecting the visual contouring of the visualelement is performed considering at least one of a distance factorbetween the simulated vehicle and the visual element in the computergenerated environment and a relative contrast between the pre-definedvisual characteristics of the visual element and underlying computergenerated environment elements. The distance factor and the relativecontrast are determined in real-time during execution of the interactivecomputer simulation prior to rendering the visual element for display.In some embodiments, dynamically affecting the visual contouring of thevisual element is performed considering both the distance factor and therelative contrast.

Optionally, dynamically affecting the visual contouring of the visualelement considering the relative contrast may comprise modulating aplurality of pixels surrounding the visual element for obtaining atarget contrast level with the underlying computer generated environmentelements.

The visual contouring may be provided, in some embodiments, by a hollowthree-dimensional mesh associated with the visual element to increasecontour thickness of the visual element.

The method may further optionally comprise modifying at least one of thepre-defined visual characteristics of the visual element considering arelative directional vector between the simulated vehicle and the visualelement in the computer generated environment and/or one or morepre-identified distinctive visual characteristics of the visual element.Modifying at least one of the pre-defined visual characteristics of thevisual element may further optionally be performed by associating ahighlighting three-dimensional mesh with the visual element to highlightthe one or more pre-identified distinctive visual characteristics of thevisual element. Alternately, or in addition, modifying the at least oneof the pre-defined visual characteristics of the visual element maybeperformed by applying one or more tailoring parameters determinedconsidering at least one of an identity of the trainee and an identifierof the visual element. In certain embodiments, the one or more tailoringparameters are further applied when dynamically affecting the visualcontouring of the visual element is performed.

Optionally, dynamically affecting the visual contouring of the visualelement may also be performed by applying one or more tailoringparameters determined considering at least one of an identity of thetrainee and an identifier of the visual element.

In accordance with a second aspect in the first set of embodiments ofthe present invention, an interactive computer simulation station isprovided. The interactive computer simulation station comprises atangible instrument module, a display system and a processor modulecomprising a dedicated graphics unit.

The tangible instrument module is for receiving one or more commandsfrom a trainee thereof for controlling, in a computer generatedenvironment from an interactive computer simulation, a simulated vehiclein the interactive computer simulation;

The display system is for displaying rendered images of the computergenerated environment comprising a visual element having associatedtherewith pre-defined visual characteristics comprising a visualcontouring;

The processor module, comprising the dedicated graphics unit, uponloading the visual element for display at the interactive computersimulation station, dynamically affects the visual contouring of thevisual element, The processor module dynamically affects the visualelement by considering at least one of a distance factor between thesimulated vehicle and the visual element in the computer generatedenvironment and a relative contrast between the pre-defined visualcharacteristics of the visual element and underlying computer generatedenvironment elements. The processor module determines the distancefactor and the relative contrast in real-time during execution of theinteractive computer simulation prior to rendering the visual element bythe dedicated graphics unit.

In certain embodiments, the processor module may dynamically affect thevisual contouring of the visual element considering both the distancefactor and the relative contrast.

The processor module may also optionally dynamically affect the visualcontouring of the visual element considering the relative contrast bymodulating a plurality of pixels surrounding the visual element forobtaining a target contrast level with the underlying computer generatedenvironment elements.

The visual contouring may be provided, in certain embodiments, by ahollow three-dimensional mesh associated with the visual element toincrease contour thickness of the visual element.

The processor module may further modify at least one of the pre-definedvisual characteristics of the visual element considering at least one ofa relative directional vector between the simulated vehicle and thevisual element in the computer generated environment and one or morepre-identified distinctive visual characteristics of the visual element.The processor module may further optionally modify the at least one ofthe pre-defined visual characteristics of the visual element byassociating a highlighting three-dimensional mesh with the visualelement to highlight the one or more pre-identified distinctive visualcharacteristics of the visual element. The processor module may also,additionally or alternatively, modify the at least one of thepre-defined visual characteristics of the visual element by applying oneor more tailoring parameters determined considering at least one of anidentity of the trainee and an identifier of the visual element. The oneor more tailoring parameters may also optionally further be applied whenthe processor module dynamically affects the visual contouring of thevisual element.

The processor module may also optionally dynamically affect the visualcontouring of the visual element by applying one or more tailoringparameters determined considering at least one of an identity of thetrainee and an identifier of the visual element.

In certain embodiments, the one or more tailoring parameters identify,considering the identity of the trainee, the one or more pre-identifieddistinctive visual characteristics of the visual element from aplurality of visual characteristics thereof. in additional oralternately, the one or more tailoring parameters may specify,considering the identifier of the visual element of the trainee, anadvancement value for one or more abilities of the trainee related todetection of the visual element, orientation determination for thevisual element, approximate range determination for the visual elementand identification of the visual element.

In accordance with a first aspect in a second set of embodiments of thepresent invention, a method is provided for dynamically modifying, in aninteractive computer simulation station, visual rendering of a visualelement in a computer generated environment from an interactive computersimulation. One or more pre-identified distinctive visualcharacteristics are associated with the visual element. The methodcomprises receiving, via a tangible instrument module, one or morecommands from a trainee of the interactive computer simulation stationfor controlling, in the computer generated environment, a simulatedvehicle of the interactive computer simulation. The method alsocomprises, upon loading the visual element for display at theinteractive computer simulation station, dynamically modifying the oneor more pre-identified distinctive visual characteristics of the visualelement considering at least a relative directional vector between thesimulated vehicle and the visual element in the computer generatedenvironment, the relative directional vector being determined inreal-time during execution of the interactive computer simulation priorto rendering the visual element for display.

Optionally, dynamically modifying the one or more pre-identifieddistinctive visual characteristics of the visual element may beperformed by associating a highlighting three-dimensional mesh with thevisual element to highlight the one or more pre-identified distinctivevisual characteristics of the visual element.

The method may optionally further comprise dynamically affecting avisual contouring of the visual element considering at least one of adistance factor between the simulated vehicle and the visual element inthe computer generated environment and a relative contrast between thepre-defined visual characteristics of the visual element and underlyingcomputer generated environment elements. Dynamically affecting thevisual contouring of the visual element may optionally be performedconsidering both the distance factor and the relative contrast.Dynamically affecting the visual contouring of the visual elementconsidering the relative contrast may optionally comprise modulating aplurality of pixels surrounding the visual element for obtaining atarget contrast level with the underlying computer generated environmentelements. The visual contouring may optionally be provided by a hollowthree-dimensional mesh associated with the visual element to increasecontour thickness of the visual element.

Affecting the visual contouring may, in certain embodiments, beperformed by applying one or more tailoring parameters determinedconsidering at least one of an identity of the trainee and an identifierof the visual element. The one or more tailoring parameters may alsofurther be applied when dynamically modifying the one or morepre-identified distinctive visual characteristics of the visual elementis performed.

Dynamically modifying the one or more pre-identified distinctive visualcharacteristics of the visual element may, in certain embodiments, beperformed by applying one or more tailoring parameters determinedconsidering at least one of an identity of the trainee and an identifierof the visual element.

In accordance with a second aspect in the second set of embodiments ofthe present invention, an interactive computer simulation station. Theinteractive computer simulation station comprises a tangible instrumentmodule, a display system and a processor module comprising a dedicatedgraphics unit.

The tangible instrument module is for receiving one or more commandsfrom a trainee thereof for controlling, in a computer generatedenvironment from an interactive computer simulation, a simulated vehiclein the interactive computer simulation;

The display system is for displaying rendered images of the computergenerated environment comprising a visual element having associatedtherewith pre-defined visual characteristics comprising a visualcontouring.

The processor module, comprising the dedicated graphics unit, uponloading the visual element for display at the interactive computersimulation station, dynamically modifies the one or more pre-identifieddistinctive visual characteristics of the visual element considering atleast a relative directional vector between the simulated vehicle andthe visual element in the computer generated environment, the relativedirectional vector being determined by the processor module in real-timeduring execution of the interactive computer simulation prior torendering the visual element by the dedicated graphics unit.

In certain embodiments, the processor module dynamically modifies theone or more pre-identified distinctive visual characteristics of thevisual element by associating a highlighting three-dimensional mesh withthe visual element to highlight the one or more pre-identifieddistinctive visual characteristics of the visual element.

The processor module may further dynamically affect a visual contouringof the visual element considering at least one of a distance factorbetween the simulated vehicle and the visual element in the computergenerated environment and a relative contrast between the pre-definedvisual characteristics of the visual element and underlying computergenerated environment elements. The processor module dynamically mayoptionally affect the visual contouring of the visual elementconsidering both the distance factor and the relative contrast. Theprocessor module may also dynamically affect the visual contouring ofthe visual element considering the relative contrast by modulating aplurality of pixels surrounding the visual element for obtaining atarget contrast level with the underlying computer generated environmentelements. In certain embodiments, the visual contouring is provided by ahollow three-dimensional mesh associated with the visual element toincrease contour thickness of the visual element. The processor modulemay yet also affect the visual contouring by applying one or moretailoring parameters determined considering at least one of an identityof the trainee and an identifier of the visual element. The one or moretailoring parameters may optionally further be applied when theprocessor module dynamically modifies the one or more pre-identifieddistinctive visual characteristics of the visual element.

In certain embodiments, the processor module dynamically modifies theone or more pre-identified distinctive visual characteristics of thevisual element by applying one or more tailoring parameters determinedconsidering at least one of an identity of the trainee and an identifierof the visual element.

In certain embodiments, the one or more tailoring parameters identify,considering the identity of the trainee, the one or more pre-identifieddistinctive visual characteristics of the visual element from aplurality of visual characteristics thereof. in additional oralternately, the one or more tailoring parameters may specify,considering the identifier of the visual element of the trainee, anadvancement value for one or more abilities of the trainee related todetection of the visual element, orientation determination for thevisual element, approximate range determination for the visual elementand identification of the visual element.

In accordance with a first aspect in a third set of embodiments of thepresent invention, a method for dynamically modifying, in an interactivecomputer simulation station, visual rendering of a visual element in acomputer generated environment from an interactive computer simulationis provided. Pre-defined visual characteristics are associated with thevisual element. The method comprises receiving, via a tangibleinstrument module, one or more commands from a trainee of theinteractive computer simulation station for controlling, in the computergenerated environment, a simulated vehicle of the interactive computersimulation. the method also comprises, upon loading the visual elementfor display at the interactive computer simulation station, dynamicallyaffecting the visual element by enhancing at least one of a visualcontouring of the visual element and one or more pre-identifieddistinctive visual characteristics of the visual element. Dynamicallyaffecting the visual element is performed by applying one or moretailoring parameters determined considering at least one of an identityof the trainee in the interactive computer simulation station and anidentifier of the visual element. Dynamically affecting the visualelement by applying the one or more tailoring parameters is performed inreal-time during execution of the interactive computer simulation priorto rendering the visual element for display.

In certain embodiments, the one or more tailoring parameters identify,considering the identity of the trainee, the one or more pre-identifieddistinctive visual characteristics of the visual element from aplurality of visual characteristics thereof. in additional oralternately, the one or more tailoring parameters may specify,considering the identifier of the visual element of the trainee, anadvancement value for one or more abilities of the trainee related todetection of the visual element, orientation determination for thevisual element, approximate range determination for the visual elementand identification of the visual element.

The method may optionally further comprise dynamically affecting avisual contouring of the visual element considering at least one of adistance factor between the simulated vehicle and the visual element inthe computer generated environment and a relative contrast between thepre-defined visual characteristics of the visual element and underlyingcomputer generated environment elements. Dynamically affecting thevisual contouring of the visual element may optionally be performedconsidering both the distance factor and the relative contrast.Dynamically affecting the visual contouring of the visual elementconsidering the relative contrast may optionally comprise modulating aplurality of pixels surrounding the visual element for obtaining atarget contrast level with the underlying computer generated environmentelements. The visual contouring may optionally be provided by a hollowthree-dimensional mesh associated with the visual element to increasecontour thickness of the visual element.

The method may further optionally comprise modifying at least one of thepre-defined visual characteristics of the visual element considering arelative directional vector between the simulated vehicle and the visualelement in the computer generated environment and/or one or morepre-identified distinctive visual characteristics of the visual element.Modifying at least one of the pre-defined visual characteristics of thevisual element may further optionally be performed by associating ahighlighting three-dimensional mesh with the visual element to highlightthe one or more pre-identified distinctive visual characteristics of thevisual element.

In accordance with a second aspect in the third set of embodiments ofthe present invention, an interactive computer simulation station isprovided. The interactive computer simulation station comprises atangible instrument module, a display system and a processor modulecomprising a dedicated graphics unit.

The tangible instrument module is for receiving one or more commandsfrom a trainee thereof for controlling, in a computer generatedenvironment from an interactive computer simulation, a simulated vehiclein the interactive computer simulation.

The display system is for displaying rendered images of the computergenerated environment comprising a visual element;

The processor module, comprising a dedicated graphics unit, upon loadingthe visual element for display at the interactive computer simulationstation, dynamically affects the visual element by enhancing at leastone of a visual contouring of the visual element and one or morepre-identified distinctive visual characteristics of the visual element.The processor module dynamically affects the visual element by applyingone or more tailoring parameters determined considering at least one ofan identity of the trainee in the interactive computer simulationstation and an identifier of the visual element. The processor moduledynamically affects the visual element by applying the one or moretailoring parameters in real-time during execution of the interactivecomputer simulation prior to rendering the visual element by thededicated graphics unit.

The one or more tailoring parameters may identify, considering theidentity of the trainee, the one or more pre-identified distinctivevisual characteristics of the visual element from a plurality of visualcharacteristics thereof. The one or more tailoring parameters may alsospecify, considering the identifier of the visual element of thetrainee, an advancement value for one or more abilities of the traineerelated to detection of the visual element, orientation determinationfor the visual element, approximate range determination for the visualelement and identification of the visual element.

The processor module may further dynamically affect a visual contouringof the visual element considering at least one of a distance factorbetween the simulated vehicle and the visual element in the computergenerated environment and a relative contrast between the pre-definedvisual characteristics of the visual element and underlying computergenerated environment elements. The processor module dynamically mayoptionally affect the visual contouring of the visual elementconsidering both the distance factor and the relative contrast. Theprocessor module may also dynamically affect the visual contouring ofthe visual element considering the relative contrast by modulating aplurality of pixels surrounding the visual element for obtaining atarget contrast level with the underlying computer generated environmentelements. In certain embodiments, the visual contouring is provided by ahollow three-dimensional mesh associated with the visual element toincrease contour thickness of the visual element.

The processor module may further modify at least one of the pre-definedvisual characteristics of the visual element considering at least one ofa relative directional vector between the simulated vehicle and thevisual element in the computer generated environment and one or morepre-identified distinctive visual characteristics of the visual element.The processor module may further optionally modify the at least one ofthe pre-defined visual characteristics of the visual element byassociating a highlighting three-dimensional mesh with the visualelement to highlight the one or more pre-identified distinctive visualcharacteristics of the visual element.

BRIEF DESCRIPTION OF THE DRAWINGS

Further features and exemplary advantages of the present invention willbecome apparent from the following detailed description, taken inconjunction with the appended drawings, in which:

FIG. 1 is a modular representative of an exemplary interactive computersimulation system in accordance with the teachings of the presentinvention;

FIG. 2 is a flow chart of an exemplary method in accordance with a firstset of embodiments;

FIG. 3 is a flow chart of an exemplary method in accordance with asecond set of embodiments;

FIG. 4 is a flow chart of an exemplary method in accordance with a thirdset of embodiments;

FIGS. 5A to 5D, herein after referred to as FIG. 5, are exemplarydepictions of selected features related to the first, the second and/orthe third sets of exemplary embodiments wherein an exemplary visualelement is presented at different levels of resolutions;

FIG. 6 is a depiction of an exemplary dynamic visual contouring wherepixels surrounding the visual element are modulated method in accordancewith exemplary embodiments;

FIG. 7, FIG. 8 and FIG. 9 are depictions of exemplary visual elementswhere additional visual information is provided therewith in accordancewith exemplary embodiments; and

FIG. 10A and FIG. 10B, herein after referred to as FIG. 10, exemplifyenhancement of specific characteristics of a visual element inaccordance with exemplary embodiments.

DETAILED DESCRIPTION

Development of the different embodiments of the present invention hasbeen triggered by, among other things, comments made by pilots trainingin interactive computer flight simulation stations when performing aDetection-Orientation-Range-Identification (DORI) benchmark test. Manyof them feel that the resolution of the visual imaging systems from theinteractive computer simulation station is lower than the perceivedresolution when flying in an actual aircraft. It is acknowledged thatmany pilots in training have particularly high visual acuity, whichserves them well.

Different solutions have been proposed to perfect the current system,including using one or more dedicated target projectors with higherresolution. This generally, however, causes a higher level of brightnessof the visual element images against the background light thus reducingthe details of the visual element and reducing the accuracy of thesimulation as well as the visual impact of the training. The addition ofhardware components also means, among other drawbacks, limitedscalability and greater exposure to failures. Another solution exploredinclude increasing sharpness of the displayed image throughout thedisplay panel, which creates artefacts that disturb the user and fail toprovide the required level of immersivity. It has also been attempted tomagnify a portion of the image that contains the visual element, but itfailed to properly but this solution also creates artefacts that disturbthe user and fail to provide the required level of immersivity.

As mentioned previously, the benchmark is meant to provide a correlationbetween a trainee's ability as measured and developed in the interactivecomputer simulation and the actual trainee's ability in the actualsystems. An additional benefit to be sought, in certain circumstances,is to adapt the benchmark to the capacity of the trainee in order tobuild the required abilities over time.

It is important to note that the present invention relates tomodification/enhancement of images rendered in the context of aninteractive computer simulation for which the characteristics of thevisual element to be modified/enhanced are well known by the underlyingcomputer simulation system. That is to say that the challenges answeredby the present invention do not relate to the proper tracking andpositioning of the visual element in an existing image (e.g., from avideo feed or pre-rasterized), but by the proper onscreen-depiction ofthe visual element considering various factors determined in the contextof the interactive computer simulation, at least one of the variousfactors being determined in real-time (or real-time priority processing)during execution of the interactive computer simulation.

Once looking for a solution to the aforementioned issues, differentcooperating, yet potentially independent solutions have been developedand are highlighted below. The skilled person will readily acknowledgethat features described in the context of one of the embodiments of theinvention can be adapted and used in the context of the otherembodiments.

In a first set of embodiments, a dynamic visual element contouringcomputer graphics system and related method is provided. The visualelement (e.g., target object) is dynamically defined based onrequirements (e.g., time of the day) of the training session. Contoursof the visual element are modified by modulation, e.g., emphasizedconsidering the training session's requirements (e.g., to a desiredlevel). In some embodiments, for each visual element, a hollowthree-dimensional mesh is used as an attribute to increase the thicknessof the contours. Characteristic visual features of the visual elementmay also be emphasized depending on the requirements of the trainingsession. The contours and/or visual features of the visual element mayalso be parameterized considering one or more dynamic aspects of theinteractive computer simulation (e.g., one or more of identity of thetrainee, previously measured skills of the trainee, identification ofthe visual element, relative colors of the visual element, etc.)

In a second set of embodiments, a dynamic visual element modifyingcomputer graphics system and related method is provided. The visualelement (e.g., target object) is dynamically defined based onrequirements (e.g., nature of the visual element) of the trainingsession. Characteristic visual features of the visual element aremodified before rendering, e.g., physical structure of the visualelement emphasized considering the training session's requirements. Insome embodiments, for each visual element, a three-dimensional mesh isused as an attribute to modify the visual element's physicalcharacteristics. Contours of the visual element may also be modified bymodulation depending on the training session's requirement. The contoursand/or characteristics of the visual element may also be parameterizedconsidering one or more dynamic aspects of the interactive computersimulation (e.g., one or more of identity of the trainee, previouslymeasured skills of the trainee, identification of the visual element,relative colors of the visual element, etc.)

In a third set of embodiments, a parameterized dynamic visual elementadapting computer graphics system and related method is provided. Thevisual element (e.g., target object) is defined based on dynamicparameters of the training session (e.g., one or more of identity of thetrainee, previously measured skills of the trainee, identification ofthe visual element, relative colors of the visual element, etc.).Contours and/or visual features of the visual element are adapted beforerendering considering status of the training session. In someembodiments, for each visual element, a three-dimensional mesh is usedas an attribute to dynamically adjust the visual element's contoursand/or characteristic visual features. For instance, contours of thevisual element may be modified by modulation while characteristic visualfeatures of the visual element may be emphasized depending on therequirements of the training session.

The three different sets of embodiments present features that mayadvantageously be used together, as skilled persons will readilyrecognize, but that may also be used independently. Examples providedhereinafter should be considered to be an exhaustive list of the variouspermutations of features that are otherwise presented herein.

Reference is now made to the drawings in which FIG. 1 shows a logicalmodular representation of an exemplary interactive computer simulationsystem 1000 performing one or more interactive computer simulations(such as interactive flight, land and/or marine simulations), inaccordance with the teachings of the present invention. The interactivecomputer simulation system 1000 comprises an interactive computersimulation station 1100, which may be involved in one or more of theinteractive computer simulations.

In the depicted example of FIG. 1, the interactive computer simulationstation 1100 comprises a memory module 1120, a processor module 1130 anda network interface module 1140. The processor module 1130 may representa single processor with one or more processor cores or an array ofprocessors, each comprising one or more processor cores. In someembodiments, the processor module 1130 may also comprise a dedicatedgraphics processing unit 1132. The dedicated graphics processing unit1132 may be required, for instance, when the interactive computersimulation system 1000 performs an immersive simulation (e.g., pilottraining-certified flight simulator), which requires extensive imagegeneration capabilities (i.e., quality and throughput) to maintainexpected realism of such immersive simulation (e.g., between 5 and 60 oreven 120 images rendered per seconds or maximum between 8.3 ms and 200ms for each rendered image). In some embodiments, each of the simulationstations 1100, 1200, 1300 comprise a processor module having a dedicatedgraphics processing unit similar to the dedicated graphics processingunit 1132. The memory module 1120 may comprise various types of memory(different standardized or kinds of Random Access Memory (RAM) modules,memory cards, Read-Only Memory (ROM) modules, programmable ROM, etc.).The network interface module 1140 represents at least one physicalinterface that can be used to communicate with other network nodes. Thenetwork interface module 1140 may be made visible to the other modulesof the interactive computer simulation station 1100 through one or morelogical interfaces. The actual stacks of protocols used by the physicalnetwork interface(s) and/or logical network interface(s) 1142, 1144,1146, 1148 of the network interface module 1140 do not affect theteachings of the present invention. The variants of processor module1130, memory module 1120 and network interface module 1140 usable in thecontext of the present invention will be readily apparent to personsskilled in the art.

A bus 1170 is depicted as an example of means for exchanging databetween the different modules of the interactive computer simulationstation 1100. The present invention is not affected by the way thedifferent modules exchange information between them. For instance, thememory module 1120 and the processor module 1130 could be connected by aparallel bus, but could also be connected by a serial connection orinvolve an intermediate module (not shown) without affecting theteachings of the present invention.

Likewise, even though explicit mentions of the memory module 1120 and/orthe processor module 1130 are not made throughout the description of thevarious embodiments, persons skilled in the art will readily recognizethat such modules are used in conjunction with other modules of theinteractive computer simulation station 1100 to perform routine as wellas innovative steps related to the present invention.

The interactive computer simulation station 1100 also comprises aGraphical User Interface (GUI) module 1150 comprising one or moredisplay screen(s) forming a display system, for the interactive computersimulation station 1100. The display screens of the GUI module 1150could be split into one or more flat panels, but could also be a singleflat or curved screen visible from an expected user position (not shown)in the simulation computing device. For instance, the GUI module 1150may comprise one or more mounted projectors for projecting images on acurved refracting screen. The curved refracting screen may be locatedfar enough from the user of the interactive computer program to providea collimated display. Alternatively, the curved refracting screen mayprovide a non-collimated display. Skilled person will readily understandthat the GUI module 1150 may be used in a variety of contexts notlimited to the previously mentioned examples (e.g., rear projector ontranslucent screen, front projector or regular screen, wearable displaysystem, etc.).

The interactive computer simulation system 1000 comprises a storagesystem 1500 that comprises data related to a shared computer generatedenvironment and that may further log dynamic data while the interactivecomputer simulation is performed. FIG. 1 shows examples of the storagesystem 1500 as a distinct database system 1500A, a distinct module 1500Bof the interactive computer simulation station 1100 or a sub-module1500C of the memory module 1120 of the interactive computer simulationstation 1100. The storage system 1500 may also comprise storage modules(not shown) on the simulation stations 1200, 1300. The storage system1500 may be distributed over different systems A, B, C and/or thesimulations stations 1100, 1200, 1300 or may be in a single system. Thestorage system 1500 may comprise one or more logical or physical as wellas local or remote hard disk drive (HDD) (or an array thereof). Thestorage system 1500 may further comprise a local or remote database madeaccessible to the computer system 1100 by a standardized or proprietaryinterface or via the network interface module 1140. The variants ofstorage system 1500 usable in the context of the present invention willbe readily apparent to persons skilled in the art.

An Instructor Operating Station (IOS) 1600 may be provided for allowingvarious management tasks to be performed in the interactive computersimulation system 1000. The tasks associated with the IOS 1600 allow forcontrol and/or monitoring of one or more ongoing interactive computersimulations. For instance, the IOS 1600 may be used for allowing aninstructor to participate to the interactive computer simulation andpossibly additional interactive computer simulation(s). In someembodiments, the IOS 1600 may be provided by the interactive computersimulation station 1100. In other embodiments, the IOS 1600 may beco-located with the interactive computer simulation station 1100 (e.g.,within the same room or simulation enclosure) or remote therefrom (e.g.,in different rooms or in different locations). Skilled persons willunderstand the many instances of the IOS 1600 may be concurrentlyprovided in the interactive computer simulation system 1000. The IOS1600 may provide a computer simulation management interface, which maybe displayed on a dedicated IOS display module 1610 or the GUI module1150. The IOS 1600 could be located in close proximity with thesimulation computing device, but may also be provided outside of theinteractive computer simulation station 1100, in communicationtherewith.

The IOS display module 1610 may comprise one or more display screenssuch as a wired or wireless flat screen, a wired or wirelesstouch-sensitive display, a tablet computer, a portable computer or asmart phone. When multiple interactive computer simulation station 1100,1200 and/or 1300 are present in the computer system 1000, the IOS 1600may present different views of the computer program management interface(e.g., to manage different aspects therewith) or they may all presentthe same view thereof. The computer program management interface may bepermanently shown on a first of the screens of the IOS display module1610 while a second of the screen of the IOS display module 1610 shows aview of the interactive computer simulation (i.e., adapted viewconsidering the second screen from images displayed through the GUImodule 1150). The computer program management interface may also betriggered on the IOS 1600, e.g., by a touch gesture and/or an event inthe interactive computer program (e.g., milestone reached, unexpectedaction from the user, or action outside of expected parameters, successor failure of a certain mission, etc.). The computer program managementinterface may provide access to settings of the interactive computersimulation and/or of the simulation computing device. A virtualized IOS(not shown) may also be provided to the user on the GUI module 1150(e.g., on a main screen, on a secondary screen or a dedicated screenthereof). In some embodiments, a Brief and Debrief System (BDS) may alsobe provided. The BDS may be seen as a version of the IOS 1600 usedduring playback of recorded data only.

In certain embodiments, the IOS 1600 may be used, e.g., by theinstructor in order to fulfill certain objectives of a particularsimulation or training scenario, to insert or modify a visual element(e.g., add a target aircraft, change the aircraft from one type toanother (e.g., different manufacturer or different allegiance), etc.)and/or to modify the behavior of a visual element (e.g., modify thedirection of an aircraft, modify armament status of an aircraft, etc.).One or more of the visual elements displayed through the GUI module 1500may represent other simulated elements (e.g., a simulated aircraftcontrolled from the simulation station 1200). In addition, oralternatively, one or more of the visual elements displayed through theGUI module 1500 may follow a predefined behavioral pattern (e.g.,controlled using artificial intelligence), in line with objectives of aparticular simulation or training scenario.

The tangible instrument provided by the instrument modules 1160, 1260and/or 1360 are tightly related to the element being simulated. In theexample of the simulated aircraft system, for instance in relation to anexemplary flight simulator embodiment, the instrument module 1160 maycomprise a control yoke and/or side stick, rudder pedals, a throttle, aflap switch, a transponder, a landing gear lever, a parking brakeswitch, aircraft instruments (air speed indicator, attitude indicator,altimeter, turn coordinator, vertical speed indicator, headingindicator, . . . ), etc. Depending on the type of simulation (e.g.,level of immersivity), the tangible instruments may be more or lessrealistic compared to those that would be available in an actualaircraft. For instance, the tangible instrument provided by the modules1160, 1260 and/or 1360 may replicate an actual aircraft cockpit whereactual instruments found in the actual aircraft or physical interfaceshaving similar physical characteristics are provided to the user (ortrainee). As previously described, the actions that the user or traineetakes with one or more of the tangible instruments provided via theinstrument module(s) 1160, 1260 and/or 1360 (modifying lever positions,activating/deactivating switches, etc.) allow the user or trainee tocontrol the virtual simulated element in the interactive computersimulation. In the context of an immersive simulation being performed inthe interactive computer simulation system 1000, the instrument module1160, 1260 and/or 1360 would typically support a replicate of an actualinstrument panel found in the actual system being the subject of theimmersive simulation. In such an immersive simulation, the dedicatedgraphics processing unit 1132 would also typically be required. Whilethe present invention is applicable to immersive simulations (e.g.,flight simulators certified for commercial pilot training and/ormilitary pilot training, marine simulator for lookout training, etc.),skilled persons will readily recognize and be able to apply itsteachings to other types of interactive computer simulations.

In some embodiment, an optional external input/output (I/O) module 1162and/or an optional internal input/output (I/O) module 1164 may beprovided with the instrument module 1160. Skilled people will understandthat any of the instrument modules 1160, 1260 and/or 1360 may beprovided with one or both of the I/O modules such as the ones depictedfor the interactive computer simulation station 1100. The externalinput/output (I/O) module 1162 of the instrument module 1160, 1260and/or 1360 may connect one or more external tangible instruments (notshown) therethrough. The external I/O module 1162 may be required, forinstance, for interfacing the interactive computer simulation system1000 with one or more tangible instrument identical to an OriginalEquipment Manufacturer (OEM) part that cannot be integrated into theinteractive computer simulation station 1100 and/or the simulationstation(s) 1200, 1300 (e.g., a tangible instrument exactly as the onethat would be found in the actual system subject of the interactivesimulation). The internal input/output (1/0) module 1162 of theinstrument module 1160, 1260 and/or 1360 may connect one or moretangible instruments integrated with the instrument module 1160, 1260and/or 1360. The 1/0 1162 may comprise necessary interface(s) toexchange data, set data or get data from such integrated tangibleinstruments. The internal 1/0 module 1162 may be required, for instance,for interfacing the interactive computer simulation system 1000 with oneor more integrated tangible instrument identical to an OriginalEquipment Manufacturer (OEM) part (e.g., a tangible instrument exactlyas the one that would be found in the actual system subject of theinteractive simulation). The I/O 1162 may comprise necessaryinterface(s) to exchange data, set data or get data from such integratedtangible instruments.

The instrument module 1160 may comprise one or more physical module thatmay further be interconnected to provide a given configuration of theinteractive computer program. As can be readily understood, instrumentsof the instrument module 1160 are expected to be manipulated by the userof the interactive computer simulation to input commands thereto.

The instrument module 1160 may yet also comprise a mechanical instrumentactuator (not shown) providing one or more mechanical assemblies forphysically moving one or more of the tangible instruments of theinstrument module 1160 (e.g., electric motors, mechanical dampeners,gears, levers, etc.). The mechanical instrument actuator may receive oneor more sets of instructions (e.g., from the processor module 1130) forcausing one or more of the instruments to move in accordance with adefined input function. The mechanical instrument actuator of theinstrument module 1160 may also alternatively or in addition be used forproviding feedback (e.g., visual, haptic, . . . ) to the user of theinteractive computer simulation through tangible and/or simulatedinstrument(s) (e.g., touch screens, or replicated elements of anaircraft cockpit or of an operating room). Additional feedback devicesmay be provided with the interactive computer simulation station 1100 orin the interactive computer simulation system 1000 (e.g., vibration ofan instrument, physical movement of a seat of the user and/or physicalmovement of the whole system, etc.).

The interactive computer simulation station 1100 may also comprise oneor more seats (not shown) or other ergonomically designed tools (notshown) to assist the user of the interactive computer simulation ingetting into proper position to gain access to some or all of theinstrument module 1160.

In the depicted example of FIG. 1, the interactive computer simulationsystem 1000 shows optional interactive computer simulation stations1200, 1300, which may communicate through the network 1400 with theinteractive computer simulation station 1100. The stations 1200, 1300may be associated to the same instance of the interactive computersimulation with a shared computer generated environment where users ofthe interactive computer simulation station 1100 and stations 1200, 1300may interact with one another in a single simulation. The singlesimulation may also involve other simulation computing device(s) (notshown) co-located with the simulation computing device or remotetherefrom. The simulation computing device and stations 1200, 1300 mayalso be associated with different instances of the interactive computersimulation, which may further involve other simulation computingdevice(s) (not shown) co-located with the interactive computersimulation station 1100 or remote therefrom.

In the context of the depicted embodiments, runtime execution, real-timeexecution or real-time priority processing execution corresponds tooperations executed during the interactive computer simulation that mayhave an impact on the perceived quality of the interactive computersimulation from a user perspective. An operation performed at runtime,in real-time or using real-time priority processing thus typically needsto meet certain performance constraints that may be expressed, forinstance, in terms of maximum time, maximum number of frames, and/ormaximum number of processing cycles. For instance, in an interactivesimulation having a frame rate of 60 frames per second, it is expectedthat a modification performed within 5 to 10 frames will appear seamlessto the user. Likewise, in an interactive simulation having a frame rateof 120 frames per second, it is expected that a modification performedwithin 10 to 20 frames will appear seamless to the user. Skilled personswill readily recognize that real-time processing may not actually beachievable in absolutely all circumstances in which rendering images isrequired. The real-time priority processing required for the purpose ofthe disclosed embodiments relates to perceived quality of service by theuser of the interactive computer simulation, and does not requireabsolute real-time processing of all dynamic events, even if the userwas to perceive a certain level of deterioration of quality of servicethat would still be considered plausible.

A simulation network (e.g., overlaid on the network 1400) may be used,at runtime (e.g., using real-time priority processing or processingpriority that the user perceives as real-time), to exchange information(e.g., event-related simulation information). For instance, movements ofa vehicle associated to the interactive computer simulation station 1100and events related to interactions of a user of the interactive computersimulation station 1100 with the interactive computer generatedenvironment may be shared through the simulation network. Likewise,simulation-wide events (e.g., related to persistent modifications to theinteractive computer generated environment, lighting conditions,modified simulated weather, etc.) may be shared through the simulationnetwork from a centralized computer system (not shown) or from one ofthe stations 1100, 1200, 1300. In addition, the storage module 1500(e.g., a networked database system) accessible to all components of theinteractive computer simulation system 1000 involved in the interactivecomputer simulation may be used to store data necessary for renderinginteractive computer generated environment. In some embodiments, thestorage module 1500 is only updated from the centralized computer systemand the simulation computing device and stations 1100, 1200, 1300 onlyload data therefrom.

Various network links may be implicitly or explicitly used in thecontext of the present invention. While a link may be depicted as awireless link, it could also be embodied as a wired link using a coaxialcable, an optical fiber, a category 5 cable, and the like. A wired orwireless access point (not shown) may be present on the link between.Likewise, any number of routers (not shown) may be present and part ofthe link, which may further pass through the Internet.

The present invention is not affected by the manner in which thedifferent modules exchange information between them. For instance, thememory module and the processor module could be connected by a parallelbus, but could also be connected by a serial connection or involve anintermediate module (not shown) without affecting the teachings of thepresent invention.

FIG. 5A, FIG. 5B, FIG. 5C and FIG. 5D, hereinafter referred to as FIG.5, present an exemplary visual element (e.g., an airplane) at differentlevels of resolutions. In the different levels of resolutions, the samevisual element is depicted as perceived from different distances fromthe position of a virtual camera in the interactive computerenvironment. As such, depending on the distance, more or less pixelswill be available to depict the visual element. An example of dynamicvisual contouring where pixels surrounding the visual element aremodulated is presented in FIG. 6. In the example depicted in FIG. 7,FIG. 8 and FIG. 9, additional visual information is provided with thevisual element. The additional visual information may, in certainembodiments, be associated with the visual element using a hollow 3Dmesh. The additional visual information may also, in certainembodiments, be associated with the visual element by modifying the 3Dmesh of the visual element and/or by associating an additional metadatastructure therewith that contains sufficient data to display theadditional visual information (e.g., the additional visual informationitself or the data to allow the processor module 1130 and/or dedicatedunit 1132 to display the additional visual information. On FIG. 7, thenose (N), tail (T), right wing (R) and left wing (L) are identified. Ofcourse, other visual information could be added, whether textual or not(e.g., red and/or green points to represent the wings, etc.). On FIG. 8and FIG. 9, different examples of directional indication arrows aredepicted (e.g., over and in front of the visual element). The size ofthe arrow could be modified considering the relative distance and/or therelative speed of the visual element with the simulated vehicle. FIG.10A and FIG. 10B exemplified enhancement of specific characteristics ofa visual element (e.g., the nose of the plane, the tail of the plane,etc.) to facilitate identification thereof In the example of FIG. 10,the size of the visual characteristics is modified. Skilled persons willunderstand that, alternatively or in addition, colors and/or brightnessof the visual characteristics may also be affected. The manner in whichthe visual characteristics is modified may be defined considering anidentity of the trainee, an identifier of the visual element and/ordisplay capabilities of the simulation station. For instance, sometrainees (e.g., because of individual characteristics or because oftheir role) may have or be expected to have a certain level of accuracyfor certain visual elements compared to others. It is thereforepossible, in certain embodiments, to vary the visual characteristicsbeing modified and/or the extent of the modification based on who thetrainee is and/or the role of the trainee. The development objective forthe trainee may also be considered (e.g., simulated scenarios built toenhanced development of the capabilities). Likewise, some visualelements may require a varying degree of modification depending on theirdistinctive visual characteristics (e.g., airplanes at large or certainspecific models, aircraft carriers, water trails from boat movements,etc.). The relative direction of the visual element (if applicable) mayalso be considered to determine the visual characteristics to bemodified and/or to determine the extent of the modification to be madeto the visual characteristics (e.g., an incoming or an outgoing movingelement, relative speed (getting closer of farther) of the element,etc.). In the example of the visual element being an airplane, it mightbe that the closest distinctive visual characteristics is selectivelyenhanced (e.g., the nose for an incoming plane or the tail for anoutgoing plane or vice-versa and/or the wings for a perpendicularmovement, etc.).

Referring concurrently to FIGS. 1, 2 and 5 to 10, in accordance with thefirst set of embodiments, a method 2000 is presented for dynamicallymodifying visual rendering of a visual element in a computer generatedenvironment from an interactive computer simulation. The method 2000 isperformed 2020 in an interactive computer simulation station 1100 duringexecution of the interactive computer simulation (e.g., by the processormodule 1130 using the memory module 1120). Pre-defined visualcharacteristics comprising a visual contouring are associated with thevisual element. For instance, the visual element may be an airplane 3Dmesh which, once rendered for display, could be presented on screen asdepicted in FIG. 5. As one example, the visual contouring may beprovided by a hollow three-dimensional (3D) mesh associated with thevisual element to increase contour thickness of the visual element.

The method 2000 comprises receiving 2030, via a tangible instrumentmodule 1160, one or more commands from a trainee of the interactivecomputer simulation station 1100 for controlling, in the computergenerated environment, a simulated vehicle of the interactive computersimulation. The simulated vehicle may be an aircraft, but may also be aterrestrial or marine vehicle. The method 2000 then comprises, at theinteractive computer simulation station 1100 and during execution of theinteractive computer simulation, dynamically affecting 2050 the visualcontouring of the visual element considering at least one of a distancefactor between the simulated vehicle and the visual element in thecomputer generated environment and a relative contrast between thepre-defined visual characteristics of the visual element and underlyingcomputer generated environment elements. On the example of FIG. 5, itcan be seen that the contrast between the visual element and theunderlying computer generated environment elements is dependent upon thesimulated element itself (e.g., colors and shape), but also on thenumber of pixels used to depict the simulated element. The distancefactor and the relative contrast are determined 2040 in real-time duringexecution of the interactive computer simulation prior to rendering 2060the visual element for display. In some embodiments, dynamicallyaffecting 2050 the visual contouring of the visual element is performedconsidering both the distance factor and the relative contrast. Themethod 2000 is repeated 2070 as needed, e.g., for multiple visualelements for the interactive computer simulation.

In certain embodiments, dynamically affecting 2050 the visual contouringof the visual element is performed for the visual element when thevisual element enters a minimum visual range from the simulated elementin the interactive computer simulation. In some other embodiments,dynamically affecting 2050 the visual contouring of the visual elementmay be performed when loading the visual element for display at theinteractive computer simulation station. The minimum visual range may bedefined considering an identity of the trainee, an identifier of thevisual element and/or display capabilities of the simulation station.For instance, some trainees (e.g., because of individual characteristicsor because of their role) may have or be expected to have a visualacuity that is particularly good (or poor), which could be consideredfor determining when to begin depicting the visual element on screen. Itis therefore possible, in certain embodiments, to vary the visual rangebased on who the trainee is and/or the role of the trainee. Thedevelopment objective for the trainee may also be considered (e.g.,simulated scenarios built to enhanced development of the capabilities).Likewise, some visual elements may require a varying visual rangedepending on their expected visual characteristics (e.g., airplanes atlarge or certain specific models, aircraft carriers, water trails fromboat movements, etc.). The interactive computer simulation station 1000itself may impose constraints on the visual range, e.g., because ofmaximum resolution of the display system used therein.

Similarly to a minimum visual range, the method 2000 may also stop fromperforming the dynamic contouring of the visual element when the visualelement exits a maximum enhancement range from the simulated element inthe interactive computer simulation. Again, the maximum enhancementrange may be defined considering an identity of the trainee, anidentifier of the visual element and/or display capabilities of thesimulation station. For instance, some trainees (e.g., because ofindividual characteristics or because of their role) may have or beexpected to have a visual acuity that is particularly good (or poor),which could be considered for determining when to stop enhancing thevisual element on screen. It is therefore possible, in certainembodiments, to vary the maximum enhancement range based on who thetrainee is and/or the role of the trainee. The development objective forthe trainee may also be considered (e.g., simulated scenarios built toenhanced development of the capabilities). Likewise, some visualelements may require a varying maximum enhancement range depending ontheir expected visual characteristics (e.g., airplanes at large orcertain specific models, aircraft carriers, water trails from boatmovements, etc.).

Dynamically affecting 2050 the visual contouring of the visual elementconsidering the relative contrast may, in certain embodiments, beperformed by modulating a plurality of pixels surrounding the visualelement for obtaining a target contrast level with the underlyingcomputer generated environment elements. An example of such dynamicvisual contouring where pixels surrounding the visual element aremodulated is presented in FIG. 6. Of course, skilled person will readilyunderstand that the modulation would typically be performed in amulticolor environment and that variation of color, with or withoutvariation of intensity, may be used to increase the contrast between thevisual element and the underlying computer generated environmentelements.

In certain embodiments, the method 2000 also comprises modifying atleast one of the pre-defined visual characteristics of the visualelement considering one or more pre-identified distinctive visualcharacteristics of the visual element. For instance, as depicted in FIG.10a and FIG. 10B, specific characteristics of a visual element may beenhanced (e.g., the nose of the plane, the tail of the plane, etc.) tofacilitate identification thereof In the example of FIG. 10, the size ofthe visual characteristics is modified. Skilled persons will understandthat, alternatively or in addition, colors and/or brightness of thevisual characteristics may also be affected. The manner in which thevisual characteristics is modified may be defined considering anidentity of the trainee, an identifier of the visual element and/ordisplay capabilities of the simulation station. For instance, sometrainees (e.g., because of individual characteristics or because oftheir role) may have or be expected to have a certain level of accuracyfor certain visual elements compared to others. It is thereforepossible, in certain embodiments, to vary the visual characteristicsbeing modified and/or the extent of the modification based on who thetrainee is and/or the role of the trainee. The development objective forthe trainee may also be considered (e.g., simulated scenarios built toenhanced development of the capabilities). Likewise, some visualelements may require a varying degree of modification depending on theirdistinctive visual characteristics (e.g., airplanes at large or certainspecific models, aircraft carriers, water trails from boat movements,etc.). The relative direction of the visual element (if applicable) mayalso be considered to determine the visual characteristics to bemodified and/or to determine the extent of the modification to be madeto the visual characteristics (e.g., an incoming or an outgoing movingelement, relative speed (getting closer of farther) of the element,etc.). In the example of the visual element being an airplane, it mightbe that the closest distinctive visual characteristics is selectivelyenhanced (e.g., the nose for an incoming plane or the tail for anoutgoing plane or vice-versa and/or the wings for a perpendicularmovement, etc.).

In the example depicted in FIG. 7, FIG. 8 and FIG. 9, additional visualinformation is provided with the visual element. The additional visualinformation may, in certain embodiments, be associated with the visualelement using a hollow 3D mesh. The additional visual information mayalso, in certain embodiments, be associated with the visual element bymodifying the 3D mesh of the visual element and/or by associating anadditional metadata structure therewith that contains sufficient data todisplay the additional visual information (e.g., the additional visualinformation itself or the data to allow the processor module 1130 and/ordedicated unit 1132 to display the additional visual information. OnFIG. 7, the nose (N), tail (T), right wing (R) and left wing (L) areidentified. Of course, other visual information could be added, whethertextual or not (e.g., red and/or green points to represent the wings,etc.). On FIG. 8 and FIG. 9, different examples of directionalindication arrows are depicted (e.g., over and in front of the visualelement). The size of the arrow could be modified considering therelative distance and/or the relative speed of the visual element withthe simulated vehicle.

Referring concurrently to FIGS. 1, 3 and 5 to 10, in accordance with thesecond set of embodiments, a method 3000 is depicted for dynamicallymodifying, in an interactive computer simulation station, visualrendering of a visual element in a computer generated environment froman interactive computer simulation. The method 3000 is performed 3020 inan interactive computer simulation station 1100 during execution of theinteractive computer simulation (e.g., by the processor module 1130using the memory module 1120). One or more pre-identified distinctivevisual characteristics are associated with the visual element. Themethod 3000 comprises receiving 3030, via a tangible instrument module1160, one or more commands from a trainee of the interactive computersimulation station for controlling, in the computer generatedenvironment, a simulated vehicle of the interactive computer simulation.The method 3000 also comprises, at the interactive computer simulationstation and during execution of the interactive computer simulation,dynamically modifying 3050 the one or more pre-identified distinctivevisual characteristics of the visual element considering at least arelative directional vector between the simulated vehicle and the visualelement in the computer generated environment. The relative directionalvector being determined 3040 in real-time during execution of theinteractive computer simulation prior to rendering 3060 the visualelement for display. The method 3000 is repeated 3070 as needed formultiple visual elements for the interactive computer simulation.

Dynamically modifying 3050 the one or more pre-identified distinctivevisual characteristics of the visual element may be performed for thevisual element when the visual element enters a minimum visual rangefrom the simulated element in the interactive computer simulation and/orstopped from being performed when the visual element exits a maximumenhancement range from the simulated element in the interactive computersimulation. In some other embodiments, dynamically modifying 3050 theone or more pre-identified distinctive visual characteristics of thevisual element may be performed when loading the visual element fordisplay at the interactive computer simulation station. The minimumvisual range and/or maximum enhancement range may be defined consideringan identity of the trainee, an identifier of the visual element and/ordisplay capabilities of the simulation station. For instance, sometrainees (e.g., because of individual characteristics or because oftheir role) may have or be expected to have a visual acuity that isparticularly good (or poor), which could be considered for determiningwhen to begin and/or stop depicting the visual element on screen. It istherefore possible, in certain embodiments, to vary the range(s) basedon who the trainee is and/or the role of the trainee. The developmentobjective for the trainee may also be considered (e.g., simulatedscenarios built to enhanced development of the capabilities). Likewise,some visual elements may require a varying range depending on theirexpected visual characteristics (e.g., airplanes at large or certainspecific models, aircraft carriers, water trails from boat movements,etc.). The interactive computer simulation station 1000 itself mayimpose constraints on the visual range, e.g., because of maximumresolution of the display system used therein.

Dynamically modifying 3050 the one or more pre-identified distinctivevisual characteristics of the visual element may be performed, incertain embodiments, by associating a highlighting three-dimensionalmesh with the visual element to highlight the one or more pre-identifieddistinctive visual characteristics of the visual element.

The method 3000 may further comprise, in certain embodiments,dynamically affecting a visual contouring of the visual elementconsidering a distance factor between the simulated vehicle and thevisual element in the computer generated environment and/or a relativecontrast between the pre-defined visual characteristics of the visualelement and underlying computer generated environment elements.Dynamically affecting the visual contouring of the visual elementconsidering the relative contrast may comprise modulating a plurality ofpixels surrounding the visual element for obtaining a target contrastlevel with the underlying computer generated environment elements. Thevisual contouring may be provided by a hollow three-dimensional meshassociated with the visual element to increase contour thickness of thevisual element. Affecting the visual contouring may be performed byapplying one or more tailoring parameters determined considering atleast one of an identity of the trainee and an identifier of the visualelement. The one or more tailoring parameters may further be appliedwhen dynamically modifying 3050 the one or more pre-identifieddistinctive visual characteristics of the visual element is performed.

Dynamically modifying 3050 the one or more pre-identified distinctivevisual characteristics of the visual element may be performed byapplying one or more tailoring parameters determined considering atleast one of an identity of the trainee and an identifier of the visualelement.

Referring concurrently to FIGS. 1 and 4 to 10, in accordance with thethird set of embodiments, a method 4000 for dynamically modifying, in aninteractive computer simulation station, visual rendering of a visualelement in a computer generated environment from an interactive computersimulation is exemplified. The method 4000 is performed 4020 in aninteractive computer simulation station 1100 during execution of theinteractive computer simulation (e.g., by the processor module 1130using the memory module 1120). Pre-defined visual characteristics areassociated with the visual element. The method 4000 comprises receiving4030, via a tangible instrument module 1160, one or more commands from atrainee of the interactive computer simulation station 1100 forcontrolling, in the computer generated environment, a simulated vehicleof the interactive computer simulation. the method 4000 also comprises,at the interactive computer simulation station 1100 and during execution4020 of the interactive computer simulation, dynamically affecting 4050the visual element by enhancing at least one of a visual contouring ofthe visual element and one or more pre-identified distinctive visualcharacteristics of the visual element. Dynamically affecting 4050 thevisual element is performed by applying one or more tailoring parametersdetermined 4040 considering at least one of an identity of the traineein the interactive computer simulation station and an identifier of thevisual element. Dynamically affecting 4050 the visual element byapplying the one or more tailoring parameters is performed in real-timeduring execution 4060 of the interactive computer simulation prior torendering 4070 the visual element for display. The method 4000 isrepeated 4080 as needed for multiple visual elements for the interactivecomputer simulation.

The one or more tailoring parameters may identify, considering theidentity of the trainee, the one or more pre-identified distinctivevisual characteristics of the visual element from a plurality of visualcharacteristics thereof.

Dynamically affecting 4050 the visual element may be performed for thevisual element when the visual element enters a minimum visual rangefrom the simulated element in the interactive computer simulation and/orstopped from being performed when the visual element exits a maximumenhancement range from the simulated element in the interactive computersimulation. In some other embodiments, affecting 4050 the visual elementmay be performed for the visual element may be performed when loadingthe visual element for display at the interactive computer simulationstation. The minimum visual range and/or maximum enhancement range maybe defined considering an identity of the trainee, an identifier of thevisual element and/or display capabilities of the simulation station.For instance, some trainees (e.g., because of individual characteristicsor because of their role) may have or be expected to have a visualacuity that is particularly good (or poor), which could be consideredfor determining when to begin and/or stop depicting the visual elementon screen. It is therefore possible, in certain embodiments, to vary therange(s) based on who the trainee is and/or the role of the trainee. Thedevelopment objective for the trainee may also be considered (e.g.,simulated scenarios built to enhanced development of the capabilities).Likewise, some visual elements may require a varying range depending ontheir expected visual characteristics (e.g., airplanes at large orcertain specific models, aircraft carriers, water trails from boatmovements, etc.). The interactive computer simulation station 1000itself may impose constraints on the visual range, e.g., because ofmaximum resolution of the display system used therein.

The one or more tailoring parameters may specify, considering theidentifier of the visual element of the trainee, an advancement valuefor one or more abilities of the trainee related to detection of thevisual element, orientation determination for the visual element,approximate range determination for the visual element andidentification of the visual element.

In some embodiments, dynamically affecting 4050 the visual contouring ofthe visual element considering a distance factor between the simulatedvehicle and the visual element in the computer generated environmentand/or a relative contrast between the pre-defined visualcharacteristics of the visual element and underlying computer generatedenvironment elements. Dynamically affecting the visual contouring of thevisual element considering the relative contrast comprises modulating aplurality of pixels surrounding the visual element for obtaining atarget contrast level with the underlying computer generated environmentelements. The visual contouring may be provided by a hollowthree-dimensional mesh associated with the visual element to increasecontour thickness of the visual element.

Modifying at least one of the pre-defined visual characteristics of thevisual element may be performed considering at least one of a relativedirectional vector between the simulated vehicle and the visual elementin the computer generated environment and one or more pre-identifieddistinctive visual characteristics of the visual element. Modifying atleast one of the pre-defined visual characteristics of the visualelement may be performed by associating a highlighting three-dimensionalmesh with the visual element to highlight the one or more pre-identifieddistinctive visual characteristics of the visual element.

In a fourth set of embodiments, the first, second and third sets ofembodiments are modified to train a user in a fixed simulate system (vs.a simulate vehicle) that needs to train in identification of a remotevisual element (e.g., an air traffic controller in a control towertraining to identify incoming and/or grounded airplanes). The challengesare similar concerning the visual element without having to considermovement of the simulated vehicle controlled from the interactivecomputer simulation station. Still, while no movement is involved, thetrainee in the fixed simulated system still has an instrument modulethat the trainee uses to interact with the interactive computersimulation.

A method is generally conceived to be a self-consistent sequence ofsteps leading to a desired result. These steps require physicalmanipulations of physical quantities. Usually, though not necessarily,these quantities take the form of electrical or magnetic/electromagneticsignals capable of being stored, transferred, combined, compared, andotherwise manipulated. It is convenient at times, principally forreasons of common usage, to refer to these signals as bits, values,parameters, items, elements, objects, symbols, characters, terms,numbers, or the like. It should be noted, however, that all of theseterms and similar terms are to be associated with the appropriatephysical quantities and are merely convenient labels applied to thesequantities. The description of the present invention has been presentedfor purposes of illustration but is not intended to be exhaustive orlimited to the disclosed embodiments. Many modifications and variationswill be apparent to those of ordinary skill in the art. The embodimentswere chosen to explain the principles of the invention and its practicalapplications and to enable others of ordinary skill in the art tounderstand the invention in order to implement various embodiments withvarious modifications as might be suited to other contemplated uses.

What is claimed is:
 1. A method for dynamically modifying, in aninteractive computer simulation station, visual rendering of a visualelement in a computer generated environment from an interactive computersimulation, wherein pre-defined visual characteristics comprising avisual contouring are associated with the visual element, the methodcomprising: receiving, via a tangible instrument module, one or morecommands from a trainee of the interactive computer simulation stationfor controlling, in the computer generated environment, a simulatedvehicle of the interactive computer simulation; and at the interactivecomputer simulation station and during execution of the interactivecomputer simulation, dynamically affecting the visual contouring of thevisual element considering at least one of: a distance factor betweenthe simulated vehicle and the visual element in the computer generatedenvironment; and a relative contrast between the pre-defined visualcharacteristics of the visual element and underlying computer generatedenvironment elements; wherein the distance factor and the relativecontrast are determined in real-time during execution of the interactivecomputer simulation prior to rendering the visual element for display.2. The method of claim 1, wherein dynamically affecting the visualcontouring of the visual element is performed considering both thedistance factor and the relative contrast.
 3. The method of claim 1,wherein dynamically affecting the visual contouring of the visualelement is performed for the visual element when the visual elemententers a minimum visual range from the simulated element in theinteractive computer simulation.
 4. The method of claim 3, wherein theminimum visual range is defined considering at least one of an identityof the trainee, an identifier of the visual element and displaycapabilities of the simulation station.
 5. The method of claim 1,wherein dynamically affecting the visual contouring of the visualelement stops from being performed when the visual element exits amaximum enhancement range from the simulated element in the interactivecomputer simulation.
 6. The method of claim 1, wherein dynamicallyaffecting the visual contouring of the visual element considering therelative contrast comprises modulating a plurality of pixels surroundingthe visual element for obtaining a target contrast level with theunderlying computer generated environment elements.
 7. The method ofclaim 1, wherein the visual contouring is provided by a hollowthree-dimensional mesh associated with the visual element to increasecontour thickness of the visual element.
 8. The method of claim 1,further comprising modifying at least one of the pre-defined visualcharacteristics of the visual element considering at least one of: arelative directional vector between the simulated vehicle and the visualelement in the computer generated environment and; one or morepre-identified distinctive visual characteristics of the visual element.9. The method of claim 8, wherein modifying at least one of thepre-defined visual characteristics of the visual element is performed byassociating a highlighting three-dimensional mesh with the visualelement to highlight the one or more pre-identified distinctive visualcharacteristics of the visual element.
 10. The method of claim 8,wherein modifying the at least one of the pre-defined visualcharacteristics of the visual element is performed by applying one ormore tailoring parameters determined considering at least one of anidentity of the trainee and an identifier of the visual element, whereinthe one or more tailoring parameters are applied when dynamicallyaffecting the visual contouring of the visual element is performed. 11.The method of claim 1, wherein dynamically affecting the visualcontouring of the visual element is performed by applying one or moretailoring parameters determined considering at least one of an identityof the trainee and an identifier of the visual element.
 12. Aninteractive computer simulation station comprising: a tangibleinstrument module for receiving one or more commands from a traineethereof for controlling, in a computer generated environment from aninteractive computer simulation, a simulated vehicle in the interactivecomputer simulation; a display system for displaying rendered images ofthe computer generated environment comprising a visual element havingassociated therewith pre-defined visual characteristics comprising avisual contouring; a processor module, comprising a dedicated graphicsunit, that during execution of the interactive computer simulation:dynamically affects the visual contouring of the visual elementconsidering at least one of: a distance factor between the simulatedvehicle and the visual element in the computer generated environment;and a relative contrast between the pre-defined visual characteristicsof the visual element and underlying computer generated environmentelements; wherein the processor module determines the distance factorand the relative contrast in real-time during execution of theinteractive computer simulation prior to rendering the visual element bythe dedicated graphics unit.
 13. The interactive computer simulationstation of claim 12, wherein the processor module dynamically affectsthe visual contouring of the visual element considering both thedistance factor and the relative contrast.
 14. The interactive computersimulation station of claim 12, wherein the processor module dynamicallyaffects the visual contouring of the visual element for the visualelement when the visual element enters a minimum visual range from thesimulated element in the interactive computer simulation.
 15. Theinteractive computer simulation station of claim 14, wherein the minimumvisual range is defined considering at least one of an identity of thetrainee, an identifier of the visual element and display capabilities ofthe simulation station.
 16. The interactive computer simulation stationof claim 12, wherein the processor module stops to dynamically affectthe visual contouring of the visual element when the visual elementexits a maximum enhancement range from the simulated element in theinteractive computer simulation.
 17. The interactive computer simulationstation of claim 12, wherein the processor module dynamically affectsthe visual contouring of the visual element considering the relativecontrast by modulating a plurality of pixels surrounding the visualelement for obtaining a target contrast level with the underlyingcomputer generated environment elements.
 18. The interactive computersimulation station of claim 12, wherein the visual contouring isprovided by a hollow three-dimensional mesh associated with the visualelement to increase contour thickness of the visual element.
 19. Theinteractive computer simulation station of claim 12, wherein theprocessor module further modifies at least one of the pre-defined visualcharacteristics of the visual element considering at least one of: arelative directional vector between the simulated vehicle and the visualelement in the computer generated environment; and one or morepre-identified distinctive visual characteristics of the visual element.20. The interactive computer simulation station of claim 19, wherein theprocessor module modifies the at least one of the pre-defined visualcharacteristics of the visual element by applying one or more tailoringparameters determined considering at least one of an identity of thetrainee and an identifier of the visual element and wherein the one ormore tailoring parameters are further applied when the processor moduledynamically affects the visual contouring of the visual element.